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riNAL  SCIENTIFIC  REPORT 


on 

"Probaliility  and  Statistics  and  Applications'' 
Grant  AFOSR- 72-2350 
June  1.  1972-May  31,  1977 


I . HISTORY  AND  PERSONNEL  SUPPORTED 

This  grant  was  originally  titled  "Statistical  Problems  in  Systems, 
Maintenance,  Human  Engineering,  and  Communications".  The  current  title 
was  adopted  in  June  of  1976.  Professor  D.  S.  Moore  was  principal  inves- 
tigator from  June  1,  1972  to  May  31,  1974,  Professor  Marcel  Neuts  was 


principal  investigator  from  June  1,  1974  to  August  31,  1976,  and  Professor 


L.  J.  Gleser  was  principal  investigator  from  September  1,  1976  to  the  ter- 
mination of  the  grant  on  May  31,  1977.  Faculty  members  supported  at 
various  times  on  the  grant  were: 

Dr.  D.  S.  Moore  (June  1,  1972  - May  31,  1977), 

Dr.  Marcel  Neuts  (October  1,  1973  - August  31,  1976), 

Dr.  L.  J.  Gleser  (August  1,  1973  - May  31,  1977), 

Dr.  Prem  Puri  (May  13,  1974  - July  5,  1974) J 
Hr.  E.  Kiimko  (summer,  1975), 

Dr.  H.  Robbins  (consultant:  May  9,  10,  1974). 

Research  assistants  whose  dissertations  or  later  techni^'a!  reports  and 
papers  were  supported  by  the  grant  were: 

W.  Spruill  (summer,  1973) , advisor:  D.  S.  Moore, 

C.  C.  Carson  (1973-1975),  advisor;  M.  Neuts, 

A,  K.  Ehargava  (1973-1975),  advisor;  L.  J.  Gleser, 


M.  Wclfson  (1975-1975),  advisor:  M.  Neuts, 

Also  partially  supported  by  ONR  grant  N00014-67-A-0226-00014 . 


w » . ,T:r^ 


S.  I-uhrmann  (1974-1976),  advisor:  M.  Neuts, 

John  p.  Heaiy  (1974-1976),  advisor;  L.  J.  Gleser, 

George  Casella  (1975-1977),  advisor:  L.  J.  Gleser, 

V.  Ramaswami  (1976-1977),  advisor:  M.  Neuts, 

D.  Mihalko  (1977),  advisor:  D.  S.  Moore, 

R.  Berger  (1977)*,  advisor:  S.  S.  Gupta. 

Many  areas  of  statistical  and  probabilistical  research  were  investigated 
during  the  period  covered  by  this  final  report.  It  seems  most  convenient 
to  organize  the  reporting  of  progress  in  these  areas  by  separately  (and 
in  alphabetical  order)  summarizing  the  work  of  each  of  the  senior  facuiiy 
members,  and  their  respective  students,  who  were  supported  under  the 
grant.  At  the  end  of  this  final  report  a chronological  bibliography  of 
publications,  technical  reports,  and  dissertations  supported  by  the 
grant  is  given, 

II.  SUMMARY  OF  RESEARCH  AND  OTHER  ACTIVITIES 
A.  Research  of  Dr.  Leon  Jay  Gleser 

1.  Multivariate  Regression  With  Errors  in  Variables 
The  model  of  regression  with  errors  in  both  independent  and  dependent 
variables  is  widely  applicable.  This  model  is  used  in  biochemical  assay, 
signal  detection  and  tracking,  measurement  of  human  performance,  studies 
of  crystalline  structure,  geology  and  seismology,  and  instrumental 
calibration  and  comparison.  The  errors-in-variables  model  is  a special  case 
of  the  linear  function  equation  models  studied  by  econometricians,  and  of 
the  fixed-factor  factor  analytic  models  of  psychometrics. 
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The  multivariate  errors-in~variables  regression  model  assumes  that 
independent  random  vectors  (x^'.y^*),  i = l,2,...,n,  are  observed,  where 
is  pxl,  y.  is  rxl. 


X.  = C.  + e. 
Ill 


y.  - + f . , 

1 1 


and  the  error  vectors  (e^'.f^*)  are  independent  (p+r) -variate  normal 

random  vectors  with  mean  vector  0 and  covariance  matrix 

Two  Ph.D,  dissertations  written  under  Dr.  Gleser's  direction,  and 

with  support  of  the  grant,  concern  statistical  inference  for  the  errors- 

in-variables  model.  A.  K.  Bhargava  finds  maximum  likelihood  estimators 

(Mt.F.)  for  the  parameters  of  the  errors-in-variables  model  under 

2 

various  assumptions  about  the  parameters.  When  <f  = o also  studi 

2 

weak  consistency  properties  of  the  Ml.E  of  B and  a , and  for  r = p = 1 

obtains  the  exact  distribution  of  the  MLE  of  B,  while  finding  an 

2 

asymptotic  representation  for  the  distribution  of  the  MLE  of  o when 
r = 1 _<  p.  Some  of  Bhargava's  results  are  published  in  Bhargava  (1977). 

The  dissertation  of  John  D.  Mealy  concerns  tests  and  MLE  for  the 
general  linear  functional  equation  model  earlier  studied  by  T.  W. 

Anderson  in  1951.  Mealy 's  results  extend  those  of  Anderson  in  that 
the  matrix  of  (regression)  parameters  is  allowed  to  increase  with  the 
sample  size.  In  consequence,  large  sample  theoiy  for  the  MLE's  and 
likelihood  ratio  tests  is  both  different  and  more  complicated  than  in 
the  fixed-dimension  case.  Mealy  also  considers  generalizations  of 
errors-in-variables  models  which  include  intercepts  and  take  account  of 
concomitant  information  that  can  be  obtained  from  design  variables. 
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llealy  dissertation  appears  as  a technical  report  [Healy  (Mimeo  Series 

471)],  and  portions  of  his  work  are  being  submitted  for  publication. 

Gleser  (Technical  Report,  Mimeo  Series  453)  studies  the  errors- 

in-variables  model  with  cp  = f.  P»  obtains  strong  consistency 

2 

and  large  sample  normality  results  for  the  MLE  of  3 and  o . Large 

2 

sample  confidence  regions  for  B and  a are  also  obtained.  A paper, 

Gleser  (1976),  concerns  an  improved  way  of  simulating  a noncentral 
Wishart  distribution  with  noncentrality  matrix  of  less  than  full  rank; 
this  new  simulation  method  will  be  useful  in  obtaining  finite-sample 
properties  of  estimators,  confidence  regions  and  tests  in  the  errors- 
in-variables  and  general  linear  functional  equation  models.  Unpublished 
work  by  Dr.  Gleser  (see  abstract  in  November,  1973,  Institute  of 
Mathematical  Statistics  Bullet  in,  #141-61)  concerns  a theory  of  intersection- 
union  tests  which  encompasses  most  known  general  methods  of  constructing 
goodness-of- f it  tests,  including  those  proposed  to  test  the  fit  of  errors- 
in-variables  and  linear  functional  relation  models. 

Finally,  a survey  paper  by  Dr.  Gleser  presented  as  an  invited  talk 
at  the  1977  Central  Regional  Meeting  of  the  Institut-e  of  Mathematical 
Statistics  reviews  some  of  the  more  important  recent  results  obtained 
by  Drs.  Gleser,  Bhargava,  Healy,  and  others  on  the  errors-in- variables  and 
general  linear  functional  relationship  models.  Negotiations  are 
currently  in  progress  to  publish  an  extended  version  of  this  paper  as 
an  invited  paper  for  the  Journal  of  the  American  Statistical  Association. 

2 . Hinimax  Estimation  of  Means  and  Regression  Parameters 
In  many  physical  and  biological  experiments  it  can  be  assumed  that 
the  coefficient  of  variation  of  the  underlying  distribution  is  known. 
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When  the  underlying  distribution  is  nomiai , Gleser  and  Mealy  (1976)  show 
that  previously  suggested  estimators  of  the  mean,  including  the  MLE, 
are  inadmissible  under  squared  error  loss,  being  dominated  in  risk  by 
a certain  admissible,  minimax,  equivariant  estimator.  A class  of 


Bayes  estimators  for  the  mean  is  also  studied. 


It  has  long  been  an  open  problem  to  construct  explicit  estimators 
of  a mean  vector  n of  a p-variate  normal  distribution  with  unknown  covariance 
matrix  1 which  dominate  the  MLE  x of  u in  risk  under  the  generalized 


I squared  error  loss: 

[ L(5(x,W),u,i:)  = (trQi:)’^(5(x,W)-u)'Q(6(x,W)-p). 

f 

f 

I Here,  <5(x,W)  is  an  estimator  of  u based  on  the  sample  mean  vector  x and 

I sample  cross-product  matrix  W obtained  from  (n+1)  i.i.d.  observations, 

I and  Q is  a known  positive  definite  matrix.  Assuming  that  the  minimum 


characteristic  root  of  QE  is  bounded  below  by  a known  positive  constant, 
Gleser  (Technical  Report,  Mimeo  Series  460)  finds  a wide  class  of 
estimators  5(x,W)  which  dominate  x in  risk.  Making  no  assumptions 
about  E whatsoever,  Berger,  Bock,  Brown,  Casella,  and  Gleser  (1977)  show 
that  the  class  of  estimators 


6(x.W)  n (I 


ot(W)  c 


(xV"^x) (n-p-1) 


where  a(W)  s minimum  characteristic  root  of  QW,  0 < c < c , and  c 

- - n>p  n,p 

are  certain  constants  tabled  through  Monte  Carlo  simulations,  dominate 
X in  risk.  The  proof  in  this  paper  is  parly  analytic,  and  partly  based 
on  simulation.  In  unpublished  results.  Dr.  Gleser  has  obtained  an 
analytic  proof  of  this  result  for  the  case  when  n is  large. 

In  his  Ph.D.  dissertation,  George  Caselia  has  investigated  the 


() 


numerical  stability  and  minimax  properties  of  adaptive  generalized  ridge 
regression  estimators  in  the  classical  linear  model: 

y = XB  + e, 

where  X:  nxp  is  known,  B:  pxl  is  uiKnown,  and  e has  an  n-variate  normal 

2 

distribution  with  mean  vector  0 and  covariance  matrix  a I . Adaptive 

n 

ridge  regression  estimators  for  the  slope  vector  have  the  form 
= (X'X  + K(B))  ^X'y,  where  K(B)  is  a matrix-valued  function  of 
B having  the  form 

K(6)  . P D|,(-,P’. 


where  P is  the  orthogonal  matrix  of  eigenvectors  of  X'X,  and  = 

diag(kj (63 ,k2(6) , . . . ,kp(B)) . When  o is  known,  Casella  o!  cains 
necessary  conditions  for  minimaxity  of  the  estimators  Bj^  under  general 
quadratic  loss  functions: 


where  Q is  a known  positive 


0 

definite  matrix.  In  the  case  where 


B'X'X0/o^ 

kj(B)  = Vi i 

B'X'XB/a^ 


i 1.2, ...  ,p. 


were  a^.  i = l,2,...,p,  are  known  nonnegative  constants,  and  r(t3  satisfies 
certain  regularity  conditions,  Casella  finds  necessary  and  sufficient  con- 
ditions for  adaptive  generalized  ridge  regression  estimators  to  be  minimax. 
Casella  also  extends  his  proofs  of  sufficiency  to  the  case  where  is 


7 

estimated  by  the  usual  estimator  based  on  least  squares  theory.  These  last 
results  appear  in  Casella  (Technical  Report,  Mimeo  Series  497] . 

In  his  thesis,  Casella  also  considers  two  definitions  of  numerical 
stability  of  an  estimator  of  B,  one  based  on  the  condition  number  of  a 
"design  matrix"  for  the  estimator,  and  the  other  based  on  the  sensitivity 
of  the  estimator  to  changes  y y + cu,  where  c is  small  and  u is 
a given  nxl  vector.  He  presents  some  evidence  to  indicate  that  in 
even  moderately  well-conditioned  designs,  minimaxity  and  numerical  stability 
for  adaptive  generalized  ridge  regression  estimators  may  be  incompatible 
requirements.  These  results  are  now  being  prepared  as  a technical  report. 

3.  Other  Research  and  Other  Activities 

The  paper  by  Closer  and  Kunte  (197(>],  which  was  revised  under  the 
present  grant,  is  a major  contribution  to  the  asymptotic  theory  of 
sequential  interval  estimation. 

During  the  period  of  this  grant.  Dr.  Closer  served  as  Associate 
Editor  of  the  Journal  of  the  Ameri can  Statistical  Association  (1971-1974] 
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B.  Research  of  Dr.  MU)jeac  M.  K1  imko 

During  the  summer  of  1975  when  he  was  partially  supported  by  the  grant. 
Dr.  Klimko  worked  in  the  partially  overlapping  areas  of  integer  programming, 
search  theory,  and  numerical  analysis  of  stochastic  models. 

Klimko  (1973  3 modifies  the  technique  of  enumerating  indice'  in 
I-aa  di  Bruno's  formula  to  obtain  a new,  more  efficient  algorithm  for 
solving  knapsack  integer  prograiiiming  problems. 

Klimko  and  Yackel  (197.*;)  obtain  optimality  results  for  a certain 
restricted  class  of  search  strategies  in  the  area  of  search  theory  of 
Wiener  processes. 

Methods  for  analyzing  the  Clearance  Problem  with  two  .servers  in 
Queueing  theory  were  investigated  by  Dr.  Klimko,  and  computer  programs 
were  written  which  show  that  two  server  clearance  problems  can  be  handled 
with  up  to  15  customers  in  each  queue.  Dr.  Klimko  also  worked  with  Dr. 

Neuts  on  a manuscript  for  a text  on  numerical  probability,  and  in  connection 
with  this  work  developed  enumeration  techniques  for  evaluation  of  the  joint 
distribution  of  points  in  a bridge  hand  (Technical  Report,  Mimeo  Series 
337) , to  demonstrate  techniques  for  efficient  data  storage  and 
enumeration  methods  in  complicated  numerical  probability  problems. 
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C.  Research  of  Dr.  D.  S.  Moore 

1 . Chi -Squared  Tests  of  Fit 

Chi-squared  tests  are  the  oldest  and  most  common  tests  of  fit. 

They  are  generally  less  powerful  than  special  purpose  tests  or  tests 
based  on  the  empirical  distribution  function,  but  have  sevet-al  major 
advantages  over  these  competing  tests.  Chi-square  tests  can  be  used 
for  data  which  are  discrete,  multivariate,  grouped,  or  even  censored. 

Other  tests  of  fit  require  drastic  modification  in  these  circumstances. 

Moreover,  other  general  tests  of  fit  have  non -tabled  distributions  when 
data  are  tested  for  fit  to  a parametric  model,  so  that  unknown  parameters 
in  the  model  must  be  estimated  from  the  data.  Properly  constructed  chi- 
square  tests  have  chi-square  limiting  null  distributions  in  great  generality, 
enabling  the  use  of  standard  tables  in  a wide  variety  of  cases.  Modern 
chi-square  tests  gai.n  their  flexibility  from  two  innovations.  The  first 
is  tlie  use  of  data-dependent  cells,  introduced  by  A.  R.  Roy  and  G.  S. 

Watson  in  the  1950's.  The  second  is  the  use  of  quadratic  forms  other  than 
the  Pearson  sum  of  squares,  due  to  D.  S.  Robson  and  his  students  in  the 
1970’s. 

Research  under  this  grant  has  produced  a general  theory  of  chi-square 
statistics  and  lead  to  increased  possibilities  for  applying  them.  Moore  and 
Spruill  (1975)  and  Moore  (1977)  are  the  major  papers  here.  The  first  gives 
the  large  sample  theory  for  the  entire  class  of  chi-.square  statistics 
with  a fixed  number  of  cells.  These  statistics  are  iionnegative  definite 
quadratic  forms  in  the  standardized  cell  frequencies,  allowing  data-depen- 
dent cells,  multivariate  data,  and  quite  general  methods  of  estimating 
unknown  parameters.  Asymptotic  distributions  under  both  the  null  hypothesis 
and  contiguous  alternatives  are  obtained.  The  limiting  null  distribution  of  such 
a statistic  is  always  that  of  a linear  combination  of  independent  chi-square 
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In  Moore  C1977),  the  quosti.-n  of  how  to  find  a statistic  having  a 
chi-square  (and  tlicreforc  tabled)  limiting  null  distribution  is  addressed. 
The  form  ol  the  .statistic  depends  on  the  method  used  to  estimate  unknown 
parameters  in  the  model.  When  minimum  chi-square  estimation  is  used, 
the  classical  Pearson-Fisher  statistic  is  appropriate.  Rao  and  Robson 
in  1974  found  the  proper  statistic  when  maximum  likelihood  estimation  is 
used,  though  without  adequate  proof.  Moore  (1977)  obtains  a general 
recipe  for  the  unique  quadratic  form  having  as  its  limiting  null 
distribution  the  chi-square  law  with  maximum  possible  degrees  of  freedom. 
The  Pearson-Fisher  and  Rao-Robson  statistics  are  special  cases  of  this. 

The  thesis  of  M.  C.  Spruill  (Spruill,  1976a  and  1976b)uses  Bahadur 
slope  to  study  both  choice  of  statistic  and  choice  of  cells  ir.  chi-square 
^ests.  Mooro  (1978)  is  a modern  exposition  of  chi  square  theory,  to  appear 
in  a volume  of  the  Mathematical  Association  of  America's  well-known  Stud i es 
series.  Moore  (197,3)  is  an  unrelated  note  on  another  goodness  of  fit 
p rob  1 em . 

Work  in  progress  includes  application  of  the  general  theory  described 
here  to  rests  of  fit  based  on  randomly  censored  data  and  to  tests  of  fit 
for  multivariate  normality,  both  problems  of  considerable  practical 
interest.  The  first  of  these  problems  is  being  pursued  by  Mr.  Daniel 
Mihalko  in  his  thesis  work.  This  work  follows  the  pattern  of  Moore  and 
.Spruill  (1975),  but  applies  to  situations  in  which  censored  (and  hence 
dependent)  observations  arc  used.  General  results  on  several  chi-square 
statistics  have  been  obtained,  and  usable  tests  of  fit  for  censored  data 
to  the  negative  exponential,  normal,  Weibull  and  uniform  families  of 
distribu  ^ns  have  been  derived.  This  work  is  being  completed  with  AFOSK 
support,  and  will  soon  be  avaible  as  a technical  report. 
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2.  Density  Estimation 

The  use  of  tne  nearest  neighbor  technique  in  density  function 

estimation  goes  back  to  Fix  and  Hodges'  classic  work  on  discrimination. 

They  and  subsequent  workers  estimated  a density  function  f(z)  by  "empiric 

measure  divided  by  Lebesque  measure"  for  the  sphere  centered  at  z with 

radius  the  distance  from  z to  the  k(n)th  nearest  of  the  observations 

X,...,X  . This  estimator  has  the  feature  that  estimation  of  f(z)  is 
I n 

entirely  controlled  by  the  k(n)  observations  nearest  to  z.  This  feature 
has  appealed  to  practitioners,  and  the  estimator  has  been  much  used  in 
discrimination,  classification  and  other  applications.  Work  under  this 
grant,  done  by  Dr.  Moore  in  collaboration  with  Dr.  James  Yackel,  has 
greatly  extended  the  nearest  neighbor  technique  and  given  an  extensive 
large  sample  theory. 

Moore  and  Yackel  (1977a)  defines  a general  class  of  nearest  neighbor 
estimators,  using  a kernel  function  to  allow  the  k(n)  observations  nearest 
z to  be  giv^n  unequal  weights.  A heuristic  analog  between  these  estimators 
and  the  well-known  Parzen-Rosenblatt  bandwidth  estimators  is  made  rigorous 
to  obtain  the  result  that  (roughly  speaking)  any  consistency  result  (point- 
wise  or  uniform,  in  probability  or  with  probability  1)  true  for  the  Parzen- 
Rosenblatt  class  is  also  true  for  the  nearest  neighbor  class  of  estimators. 
This  allows  a large  literature  to  be  immediat''!  . olied  to  nearest  neighbor 
estimators,  and  even  yields  some  new  results  he  Fix-Kodges  estimator, 

which  is  the  uniform  kernel  case  of  the  new 

In  Moore  and  Yackel  (1977b)  asymptotic  normality  and  mean  consistency 
are  proved  for  general  nearest  neighbor  density  function  estimators.  In 
addition,  a pointwise  almost  sure  consistency  theory  for  the  uniform  kernel 
case  is  obtained  under  conditions  on  k(n)  which  are  shown  to  be  best  possible. 
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3 . Other  Activities 

During  the  period  of  this  grant.  Dr.  Moore  served  as  Associate 
Editor  of  the  Journal  of  the  American  Statistical  Association . He  edited, 
with  Professor  S.  S.  Gupta,  the  volume  Statistical  Decision  Theory  and 
Related  Topics  II  (Academic  Press,  1977),  the  proceedings  of  a symposium 
held  at  Purdue  in  May,  1976  with  the  partial  support  of  AFOSR. 

Dr.  Moore  has  given  numerous  lectures  on  the  chi-square  results  ob- 
tained under  this  contract,  including  invited  lectures  at  both  the  1976 

> 

i and  1977  annual  meetings  of  the  American  Statistical  Association.  He 

1 

! also  spoke  on  this  work  as  one  of  the  lecturers  in  the  American 

t 

I 

j Mathematical  Society's  "Short  Course  in  Statistics"  held  in  conjunction 

! with  its  1977  national  meeting  in  St.  Louis. 

I Dr.  Moore  was  a lecturer  in  the  V'isiting  Lecturers  in  Statistics 

program  (1973-1977),  and  was  Program  Chairman  for  the  regional  meeting 
of  the  Institute  of  Mathematical  Statistics  held  in  Madison,  Wisconsin 
in  May,  1977. 
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D,  Research  of  Dr.  Marcel  F.  Neuts 


Thanks  to  the  funds  and  facilities  provided  by  the  Grant  AFOSR-72- 
2350,  Dr.  Neuts  has  been  able  to  maintain  an  active  research  program  in 
Computational  Probability  and  has  assumed  a leading  developmental  role  in 
this  area.  This  research  is  now  continuing  at  the  University  of  Delaware 
with  the  support  of  the  Grant  AFOSR-77-3236. 

In  addition,  secondary  research  efforts  in  the  study  of  limit  laws  for 
random  variables  defined  on  Markov  chains  and  in  the  control  of  epidemics 
were  carried  out  jointly  with  doctoral  students  at  Purdue  University. 

1.  Computational  Probability 

A very  large  body  of  literature  in  probability  deals  with  the  study 
of  stochastic  models,  such  as  queues,  inventories  and  epidemics.  For  a 
number  of  years  prior  to  1970,  it  was  pointed  out  by  practitioners  that 
many  of  the  published  results  were  not  in  a readily  computable  form  and 
that  it  was  often  difficult  to  extract  from  them  the  qualitative  information 
needed  in  real-life  implementations. 

Recognizing  the  validity  of  this  criticism.  Dr.  Neuts  began  a program 
of  investigation  into  the  algorithmic  aspects  of  stochastic  models.  From 
initial  work  on  certain  simple  discrete  queues,  the  research  has  moved  on 
in  recent  years  to  the  development  of  stable  algorithms  for  queueing 
models  of  substantial  complexity. 

The  three  most  notable  developments  obtained  in  this  work  are; 


a.  The  introduction  of  the  class  of  probability  distributions  of 
phase  type. 


b.  The  solution  without  transforms  of  a large  variety  o7  queues 
with  semi -Markovian  features. 

c.  The  identification  of  a class  of  Markov  chains,  which  in  the 
positive  recurrent  case  have  a matrix-geometric  invariant  vector 
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These  results  underlie  the  numerical  solution  by  real  arithmetic  of 
a great  variety  of  queueing  problems. 

We  shall  now  review  each  of  these  in  some  detail. 

The  PH-distribuions 

A probability  distrilution  on  [0,“),  which  can  be  considered  as  the 

distribution  of  the  time  till  abosrption  in  a finite  Markov  chain  with  m 

transient  states  and  one  absorbing  state  is  said  to  be  of  phase  type.  With 

the  initial  probability  vector  (a, a the  distribution  of  the  time  until 

— m+l 

absorption  in  the  Markov  chain 

T T® 

0 0 

is  given  by 

F(x)  = l-£  exp(Tx)ie,  for  x ^ 0. 

The  class  of  PH-distributions  contains  all  finite  mixtures  of  generalized 
Erlang  dis  ributions,  has  a large  number  of  useful  closure  properties,  and 
is  closely  related  to  systems  of  linear  differential  equations.  Their 
numerical  computation  may  be  easily  performed. 

Tne  PH-distributions  and  the  related  PH-renewal  processes  enable  one 
to  remove  from  many  stochastic  models  the  unrealistic  negative-exponential 
and  Poisson  assumptions  which  have  often  been  imposed  in  the  interest  of 
analytic  tractability. 

By  combining  results  to  be  reviewed  in  the  next  two  sections  with 
those  obtained  for  the  PH-distributions,  Dr,  Neuts  has  been  able  to  evolve 
algorithmic  solutions  to  such  queueing  models  as  PH/G/1,  GI/PH/1,  SM/PH/1 
and  others.  Since  tlieir  publication,  the  papers  on  PH-distributions  have 
received  wide  attention.  They  have  been  implemented  in  algorithmic 
work  on  stochastic  models  by  several  researchers  in  the  US,  Canada,  Australia, 
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jointly  with  a colleague  at  the  University  of  Delaware,  Dr.  Neuts 
is  currently  engaged  in  work  on  fitting  PH-distributions  to  data  by  the 
use  of  interactive  computer  graphics  and  nonlinear  optimization.  Related 
work  is  also  in  progress,  both  in  West  and  East  Germany. 

A Class  of  Markov  Chains  and  the  Markov  Renewal  Branching  Process 


There  are  approximately  twelve  substantially  different  complex 
queueing  models  of  practical  interest,  which  have  an  embedded  Markov 
chain  of  the  general  form 


The  entries  are  finite  nonnegative  matrices  of  dimensions  raxm  for 

A , V S 0,  mxn  for  C„,  nxm  for  B , v > 1,  and  nxn  for  B--  The  specific 
V—  0 V—  0 

definition  of  the  entries  of  these  submatrices  depends  on  the  application 
at  hand  and  can  be  quite  complicated. 

The  classical  methodology,  based  on  probability  generating  functions 
and  Rouche's  theorem,  involves  a number  of  irrelevant  technical  difficulties 
and  does  not  in  general  lead  to  stable,  accurate  algorithms. 

In  several  papers.  Dr.  Neuts  has  first  studied  the  first  passage  time 
from  the  set  of  states  {(i  + i,  j),  1 ^ j to  the  set  of  states 

^ j _<  m}.  For  technical  reasons,  this  first  passage  problem 
is  also  called  the  Markov  Renewal  Branching  Process.  The  key  mathematical 
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point  in  this  discussion  is  the  study  or  the  solution  to  the  nonlinear  matrix 
equation,  in  the  set  of  (sub) stochastic  matrices: 

G = i A . 

V =0 

In  the  positive  recurrent  case,  the  unique  solution  to  that  equation 
is  stochastic.  A large  number  of  computationally  useful  formulas  for 
moments  and  other  important  quantities  involve  the  matrix. G.  Once  the 
matrix  G has  been  computed,  it  is  possible  to  express  the  steady-state 
probability  vector  of  P,  as  well  as  many  queue  distributions  such  as  for 
waiting  times  and  queue  lengths^ in  terms  of  G. 

Several  of  the  papers,  published  with  the  support  of  the  grant,  deal 
with  the  theoretical  aspects  of  the  nonlinear  equation  for  G.  In  order  to 
bring  the  results  also  as  close  as  possible  to  real  applications.  Dr.  Neuts 
has  also  written  several  papers  dealing  with  specific  models,  such  as  a 
study  of  the  effect  of  change-over  times  on  the  behavior  of  a service 
system,  which  handles  several  types  of  customers.  This  problem  is  relevant 
in  computer  systems  and  also  in  versatile  numerically  controlled  machine  tools. 

Further  research  on  applications  of  this  methodology  is  currently 
still  going  on.  Wa  are  examining  the  very  versatile  queueing  model  PH/SM,  l, 
for  which  we  plan  to  write  a detailed  computer  program.  We  have  also  come 
across  new  applications,  such  as  a type  of  radio-channel  subject  to  fade- 
out  a.id  versions  of  the  two-server-in-series  model,  with  a finite  inter- 
mediate buffer. 

Markov  Chains  with  a Matrix-Geometric  Invariant  Vector 

Under  very  general  conditions.  Dr.  Neuts  has  shown  that  Markov 


chains  of  the  form 


have,  in  the  positive  recurrent  case,  an  invariant  probability  vector  jc  = 
(2^,  of  the  form 


24;  = 2So  ^ ' for  k 22  1. 


where  R is  an  irreducible,  nonnegative  matrix  of  spectral  radius  less 
than  one. 

This  theorem,  which  generalizes  a classical  result  of  Khinchin,  is 
very  useful  in  queueing  theory.  It  leads  immediately  to  the  numerical 
solution  of  queues  of  GI/PH/l  and  SM/PH/1  types.  Waiting  time  distri- 
butions, even  those  under  non-classical  queue  disciplines,  can  be 
computed  by  well-behaved  algorithms. 


The  paper  discussing  this  result  has  already  been  accepted  for 
Advances  in  Applied  Probability.  Its  applications  in  the  control  of 
queues  are  now  under  investigation.  Most  of  the  harder  problems  in 
control  of  queues  are  analytically  utterly  intractable.  Where  fast 
algorithms  are  available,  it  becomes  feasible  however  to  combine  a 
heuristic  search  procedure  with  computations  to  obtain  very  good 
approximations  to  the  optimal  procedure  within  a giver,  class.  We  believe 
that  in  the  study  of  these  problems,  our  algorithmic  research  will  bear 
its  finest  fruits. 
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This  concludes  our  review  of  the  main  effort  in  computational  prob- 
ability. Under  partial  support  of  the  grant,  three  students  completed 
their  Ph.D.  dissertations  under  the  supervision  of  Dr.  Neuts  and  a fourth 
student  is  currently  receiving  support. 

Dr.  David  B.  Wolfson  wrote  a thesis  on  limit  laws  for  sums  of  random 
variables  defined  on  a Markov  chain.  Several  papers  of  a theoretical  nature 
have  been  published  by  Dr.  Wolfson,  who  is  currently  an  Assistant  Professor 
at  McGill  University. 

Dr.  C.  C.  Carson  of  Sandia  Corporation  and  Dr.  S.  Fuhrmann  of  Rutgers 
University  have  completed  theses,  respectively,  on  the  computational 
solution  of  the  PH/PH/1  queue  and  on  the  control  of  an  epidemic,  involving 
a multistage  disease. 

2.  Other  Items  of  Interest 


In  order  to  further  research  interest  in  computational  probability, 

Dr.  Neuts  has  prepared  an  extensive  bibliography  on  algorithmic  methods  in 
probability,  which  was  published  in  the  .Journal  for  Computat ional  and 
Applied  Mathematics . 

He  has  also  edited  a special  issue  of  Management  Science  on 
Algorithmic  Methods  in  Probability,  This  volume  of  seventeen  papers  will 
appear  in  Sep.:ember  1977  as  TIMS-North  Holland  Studies  in  the  Management 
Sciences,  No.  7. 

Dr.  Neuts  was  appointed  on  September  1,  1976  to  the  Unidel  Professorship 
in  the  Department  of  Statistics  and  Computer  Science,  University  of 
Delaware . 


19 


With  the  financial  aid  of  the  Grant,  Dr.  Neuts  has  been  able  to 
attend  a number  of  important  scientific  meetings,  most  notably  the  Fourth, 
Fifth,  and  Sixth  Conferences  on  Stochastic  Processes  in  Downsview, 

Ontario,  College  Park,  Maryland,  and  Tel-Aviv,  Israel,  respectively. 

He  presented  invited  papers  at  all  of  these  conferences. 

During  the  four  year  period  covered  by  this  report.  Dr.  Neuts  has 
presented  mox'e  than  sixty  invited  lectures  on  computational  probability 
at  Universities  and  research  institutions  in  the  United  States  and  abroad. 

He  was  recently  invited  to  give  a paper  at  the  Conference  on  Optimiza- 
tion in  Statistics  to  be  held  in  Bombay,  India  and  also  to  lecture  for  five 
weeks  at  the  Indian  Institute  of  Management  in  Calcutta  during  December 
1977  - January  1978. 

Dr.  Neuts  has  also  served  as  Department  Editor  for  Applied  Stochastic 
Models  of  Management  Science  since  1974  and  has  been  active  in  the 
organization  of  several  conferences  and  regional  meetings. 
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E.  Research  of  Dr.  Prem  S.  Puri 

Dr.  Puri  wrote  three  p.rpers  under  partial  support  of  the  grant.  Puri 
(1975)  surveys  work  on  carrier-borne  epidemics,  and  then  turns  to 
study  of  a gonerii  I i /.It  ion  of  a ciirr  i«o  -hornt'  opidoinlo  model  *>f  DUm/. 
and  Downton.  In  tlie  generalized  model,  the  realistic  possibility 
of  an  infective  becoming  a susceptible  is  permitted.  Detailed  consideration 
is  given  to  the  special  case  where  the  epidemic  is  initiated  by  a 
single  carrier  with  no  further  immigration  of  carriers,  but  with  immi- 
gration of  susceptibles  allowed.  Aiaong  other  distributional  problems, 
the  distributon  problem  related  to  the  total  number  of  visits  of 
susceptibles  to  'infective*  state,  and  total  man-units  of  time  spent 
in  the  'infective'  state  during  the  time  interval  [0,t),  etc,,  are 
studied.  A closely  related  paper,  Puri  (Technical  Report,  Mimeo  Series  368), 
was  also  supported  by  the  grant. 

Puri  (1976)  is  a nonmathematical  paper  intended  for  sophisticated 
but  otherwise  nonmathematical  readers.  The  paper  starts  with  the 
emphasis  on  stochastic  models  in  biology  and  medicine  which,  because 
of  the  large  variability  among  observations  in  these  areas,  are  con- 
sidered more  appropriate  than  their  determinstic  analogs.  Again,  owing 
to  the  basic  evolutionary  characteristics  of  living  things  such  as  births 
and  deaths,  growth  and  decay  etc.,  one  is  led  in  biology  and  medicine 
to  many  dynamic  processes  of  development  in  time  and  space.  Consequently, 
the  use  of  stochastic  processes  for  model-building  tor  the  study  of 
various  biological  phenomena  becomes  quite  natural.  The  paper  attempts 
to  describe  nonmathematically  some  of  the  special  processes,  which  have 
emerged  as  useful  models  in  biology  and  medicine  over  a period  of  time. 

Among  others,  the  processes  considered  here  are  Branching  pi-ocesses. 

Birth  and  Death  processes.  Emigration- Immigration  processes.  Diffusion 
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processes,  Quantal  Response  processes.  Competition  processes,  etc . In  each 
case  a brief  sketch,  frequently  historical  in  character,  is  followed  by 
a few  examples  of  live  situations  where  these  processes  arise  in  practice. 
The  paper  ends  with  about  one  hundred  references  of  key  papers  concerning 
these  processes. 
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F.  Other  Research 

Partial  support  was  provided  to  Dr.  Roger  L.  Berger  for  completion 
of  his  dissertation  "Minimax,  Admissible,  and  F-minimax  Decision 
Rules",  written  under  the  direction  of  Professor  S.  S.  Gupta.  An 
abstract  of  this  dissertation  follows: 

Multiple  decision  problems  are  decision  theory  problems  in 
which  the  action  space  has  a finite  number  of  elements.  Two  different 
types  of  multiple  decision  problems  are  considered,  herein.  These  two 
types  of  problems  are  subset  selection  problems  and  robustness  of  Bayes 
rules  problems. 

Subset  selection  problems  arise  because  the  classical  tests  of 
homogeneity  are  often  inadequate  in  practical  situations  where  the 
experimenter  has  to  make  decisions  regarding  k(^  2)  populations, 
treatments,  or  processes.  This  inadequacy  may  be  alleviated  by 
formulating  the  problems  as  multiple  decision  problems  aimed  at  ranking 
or  selection  of  the  k populations.  A formulation  was  proposed  in  which 
the  population  of  interest  is  selected  with  a fixed  minimum  probability 
P*  over  the  entire  parameter  space.  This  formulation  is  called  the 
subset  selection  formulation. 

Chapter  I of  this  thesis  considers  rainimaxity  of  subset  selection 
rules  when  the  risk  is  the  expected  size  of  the  selected  subset  or 
the  expected  number  of  non-best  populations  selected.  The  minimax 
value  of  the  selection  problem  is  computed  for  a wide  class  of  distributions. 
It  is  found  that  two  classical  rules  are  minimax  in  location  and  scale 
parameter  problems  if  the  populations  are  independent  and  the  distributions 
have  monotone  likelihood  ratio.  Necessary  conditions  for  minimaxity  are 
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obtained  and  are  used  to  show  that  other  proposed  rules  are  not  minimax. 

The  minimaxity  of  rules  in  a proposed  class  of  rules  is  also  investigated. 
Chapter  ll  of  this  thesis  considers  minimaxity  and  admissibility  of 
selection  rules  when  the  risk  is  the  maximum  probability  of  selecting  any 
non-best  population.  It  is  found  that,  if  the  restriction  is  made  to 
non-randomi zed,  just,  and  translation  invariant  rules,  a classical  rule 
is  minimax  and  admissible  in  the  location  parameter  problem.  The 
analagous  result  holds  in  the  scale  parameter  problem  for  scale  invariant 
rules.  Other  rules  in  a proposed  class  are  found  to  behave  poorly  with 
respect  to  this  risk.  But  one  of  these  rules  is  found  to  have  a certain 
optimality  property  if  the  parameters  are  in  a slippage  configuration. 

A different  type  of  multiple  decision  problem  is  considered  in 
Chapter  III.  The  robustness  of  Bayes  rules  when  the  parameter  space  is 
finite  is  considered.  The  usual  Bayes  rules  are  found  to  be  robust  in  that 
they  are  T-minimax  when  the  original  distributions  are  replaced  by  C-con- 
taminated  versions  of  themselves.  To  derive  this  result,  some  general 
results  involving  the  relationship  of  Bayes  rules  and  r-minimax  rules 
are  obtained.  Bounds  are  obtained  on  the  amount  of  contamination  which 
may  be  present  with  the  Bayes  rule  remaining  P-minimax. 
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